Precise Error Analysis of the `2-lasso
نویسندگان
چکیده
A classical problem that arises in numerous signal processing applications asks for the reconstruction of an unknown, ksparse signal x0 ∈ R from underdetermined, noisy, linear measurements y = Ax0 + z ∈ R. One standard approach is to solve the following convex program x̂ = arg minx ‖y− Ax‖2+λ‖x‖1, which is known as the `2-LASSO. We assume that the entries of the sensing matrix A and of the noise vector z are i.i.d Gaussian with variances 1/m and σ. In the large system limit when the problem dimensions grow to infinity, but in constant rates, we precisely characterize the limiting behavior of the normalized squared error ‖x̂− x0‖2/σ. Our numerical illustrations validate our theoretical predictions.
منابع مشابه
Differenced-Based Double Shrinking in Partial Linear Models
Partial linear model is very flexible when the relation between the covariates and responses, either parametric and nonparametric. However, estimation of the regression coefficients is challenging since one must also estimate the nonparametric component simultaneously. As a remedy, the differencing approach, to eliminate the nonparametric component and estimate the regression coefficients, can ...
متن کاملEstimation with Norm Regularization
Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This paper presents generalizations of such estimation error analysis on all four aspects compared to the existing literature. We characterize the restricted error...
متن کاملSharp thresholds for high-dimensional and noisy sparsity recovery using l1-constrained quadratic programming (Lasso)
The problem of consistently estimating the sparsity pattern of a vector β ∈ R based on observations contaminated by noise arises in various contexts, including signal denoising, sparse approximation, compressed sensing, and model selection. We analyze the behavior of l1-constrained quadratic programming (QP), also referred to as the Lasso, for recovering the sparsity pattern. Our main result is...
متن کاملRegularized Linear Regression: A Precise Analysis of the Estimation Error
Non-smooth regularized convex optimization procedures have emerged as a powerful tool to recover structured signals (sparse, low-rank, etc.) from (possibly compressed) noisy linear measurements. We focus on the problem of linear regression and consider a general class of optimization methods that minimize a loss function measuring the misfit of the model to the observations with an added struct...
متن کاملHospital Performance Evaluation Using Pabon Lasso Analysis
Background and Objectives: Hospital is the largest and most costly operating unit of healthcare system. Provision of optimal care requires that hospital administrators identify hospital performance based on relevant indicators. This study used the Pabon Lasso analysis to assess the performance of hospitals and identify strategies towards an improved hospital performance. Methods: This cross...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015